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^ ■ Abstract 



. Given a finite sequence of vectors J-q in we characterize in a complete and explicit way 

' the optimal completions of obtained by adding a finite sequence of vectors with prescribed 

. norms, where optimality is measured with respect to majorization (of the eigenvalues of the 

' frame operators of the completed sequence). Indeed, we construct (in terms of a fast algorithm) 

'■^ , a vector - that depends on the eigenvalues of the frame operator of the initial sequence J-q and 

' the sequence of prescribed norms - that is a minimum for majorization among all eigenvalues of 

" ' , frame operators of completions with prescribed norms. Then, using the eigenspaces of the frame 

' operator of the initial sequence J-q we describe the frame operators of all optimal completions for 

, majorization. Hence, the concrete optimal completions with prescribed norms can be obtained 

|"t I ' using recent algorithmic constructions related with the Schur-Horn theorem. 

'^ , The well known relation between majorization and tracial inequalities with respect to convex 

' functions allow to describe our results in the following equivalent way: given a finite sequence of 

, vectors J^o in C'' we show that the completions with prescribed norms that minimize the convex 

y ' potential induced by a strictly convex function are structural minimizers, in the sense that they 
do not depend on the particular choice of the convex potential. 
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1 Introduction 



A finite sequence of vectors J- = {/i}jGi„ in is a frame for if the sequence spans C^. It is well 
known that finite frames provide (stable) linear encoding-decoding schemes. As opposed to bases, 
frame are not subject to linear independence; indeed, it turns out that the redundancy allowed in 
finite frames can be turned into robustness of the transmission scheme that they induce, which make 
frames a useful device for transmission of signals through noisy channels (see O O [TJ [15l [2ll |28l [27| ) . 

On the other hand, the so-called tight frames allow for redundant linear representations of 
vectors that are formally analogous to the linear representations given by orthonormal basis; this 
feature makes tight frames a distinguished class of frames that is of interest for applications. In 
several applications we would like to consider tight frames that have some other prescribed proper- 
ties leading to what is known in the literature as frame design problems [21 |8l [TTl [131 El IISl 113 [26] • 
It turns out that in some cases it is not possible to find a frame fulfilling the previous demands. 

An alternative approach to deal with the construction of frames with prescribed parameters and 
nice associated reconstruction formulas was posed in [3j by Benedetto and Fickus; they defined a 
functional, called the frame potential, and showed that minimizers of the frame potential (within a 
convenient set of frames) are the natural substitutes of tight frames with prescribed parameters (see 
also [m [221 [551 [3U] and [121 [311 [32] for related problems in the context of fusion frames). Moreover, 
in [30] it is shown that minimizers of the frame potential under suitable restrictions (considered in 
the literature) are structural minimizers in the sense that they coincide with minimizers of more 
general convex "potentials (see Section [2.2p . 

Recently, the following frame completion problem was posed in [20] (in the vein of [3]): given 
an initial sequence J-q in and a sequence of positive numbers a then compute the sequences Q 
in whose elements have norms given by the sequence a and such that the completed sequence 
T = (J-Q , ^) minimizes the so-called mean square error (MSE) of T ^ which is a (convex) functional 
(see also [9l [T9l [29] for completion problems for frames). In this setting, the initial sequence of 
vectors can be considered as a checking device for the measurement, and therefore we search for a 
complementary set of measurements (given by vectors with prescribed norms) in such a way that the 
complete set of measurements is optimal with respect to the MSE. Notice there are other possible 
(convex) functionals that we could choose to minimize such as, for example, the frame potential. 
Therefore, a natural extension of the previous problem is: given a functional defined on the set 
of frames, compute the frame completions with prescribed norms that minimize this functional. 
Moreover, this last problem raises the question of whether the completions that minimize these 
functionals coincide i.e., whether the minimizers are structural in this setting. 

A first step towards the solution of the general version of the completion problem was made 
in [33]- There we showed that under certain hypothesis (feasible cases, see Section [H^ . optimal 
frame completions with prescribed norms are structural (do not depend on the particular choice 
of the convex functional), as long as we consider convex potentials, that contain the MSE and the 
frame potential. On the other hand, it is easy to show examples in which the previous result does 
not apply (non- feasible cases); in these cases the optimal frame completions with prescribed norms 
were not known even for the MSE nor the frame potential. Recently, in some feasible cases the set 
of all optimal frame completions is characterized in [351 [2T] . 

In L24j we considered the structure of completions that minimize a fixed convex potential (non 
feasible case). There, we showed that the eigenvalues of optimal completions with respect to a fixed 
convex potential are uniquely determined by the solution of an optimization problem in a compact 
convex subset of M*^ for a convex objective function that is associated to the convex potential in a 
natural way. Then, we showed an important geometrical feature of optimal completions T = (J-Q) ^) 
for a fixed convex potential, namely that the vectors in the completion Q are eigenvectors of the 
frame operator of the completed sequence T (see Section 13.21 for a detailed exposition of these 
results). Based on these facts, we developed an algorithm that allowed us to compute the solutions 
of the completion problem for small dimensions. In this setting we conjectured some properties 
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of the optimal frame completions in the general case, based on common features of the solutions 
of several examples obtained by this algorithm (see Section H] for a detailed description of these 
conjectures). 

In this paper, building on our previous work [33] and ^1], we give a complete and explicit 
description of the spectral and geometrical structure of optimal completions with prescribed norms 
with respect to a convex potential induced by a strictly convex function. Our approach is construc- 
tive and allows to develop a fast and effective algorithm that computes the spectral structure of 
optimal completions. As we shall see, given an initial sequence 

Jo in and a sequence of positive 
numbers a, both the spectral and geometrical structure of optimal completions depend only on 
the frame operator of Fq and a, but they do not depend on the particular choice of the convex 
potential. Hence, we show that in the general case the minimizers of convex potentials (induced 
by strictly convex functions) are structural. 

In order to obtain the previous results, we begin by proving the properties of general optimal 
completions conjectured in j3l]. These properties (that are structural, in the sense that they do not 
depend on the convex potential) are then used to compute several other structural parameters - that 
involve the notion of feasibility developed in |33j - that completely describe the spectral structure 
of optimal completions. As a consequence of this description, we conclude that optimal solutions 
have the same eigenvalues and hence, the eigenvalues of optimal completions are minimum for the 
so-called majorization preorder. Moreover, all the parameters involved in the description of the 
spectral structure of optimal completions can be computed in terms of fast algorithms. With the 
spectral data and results from [33] we completely describe the set positive matrices that correspond 
to the frame operators of sequences Q with norms prescribed by a and such that T = {J^o-,Q) are 
optimal. Finally, some optimal completions Q can be also effectively computed by using recent 
results from [S] (see also [17j and [21j) that implements the Schur-Horn theorem. 

The paper is organized as follows. In Section [2] we briefly recall the basic framework of finite 
frame theory, the notion of submajotization - that will play a central role in this note - and the 
relation of submajorization with tracial inequalities involving convex functions. In section [3] we 
describe the context of our main problem - namely, optimal completions with prescribed norms, 
where optimality is described in terms of majorization - and give a detailed account of several 
related results that were developed in our previous works [33] and [3l] that we shall need in the 
sequel, in a way suitable for this note; in particular, we include a new construction of the spectra 
of optimal completions in the feasible cases. In Section [J] we introduce new structural parameters - 
that can be efficiently computed in terms of explicit algorithms - and show how to give a complete 
description of the spectra of optimal completions for strictly convex potentials, in terms of these 
parameters in the general case. This allow us to show that the spectra of such optimal completions 
do not depend on the choice of strictly convex potential, so that minimizers are then structural. 
The proofs of the technical results of this section is presented in Section 5. In particular, we settle in 
the affirmative some features of the structure of optimal completions for strictly convex potentials 
that were conjectured in |34j . As a byproduct we also settle in the affirmative a conjecture on local 
minimizers of strictly convex potentials with prescribed norms posed in |30j. 




2 Preliminaries 

In this section we describe the basic notions that we shall consider throughout the paper. In 
Section 12.11 we describe some general notations and terminology. In Section 12.21 we describe some 
basic notions and facts of frame theory and we recall the notion of convex potential from [3Uj. In 
Section [2.31 we describe some aspects of submajorization that we shall need in the sequel. 
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2.1 General notations. 



Given m G N we denote by Im = {1, • • • , rn} C N and 1 = 1^ G denotes the vector with ah its 
entries equal to 1. For a vector x € we denote by tr x = X]jei„ ^« ^^'^ by x-'- (resp. x^) the 
rearrangement of x in decreasing (resp. increasing) order. We denote by (M™)"^ = {x € M™ : x = 
x"^} the set of downwards ordered vectors, and similarly (M™)^. 

Given Ti = and /C = C", we denote by L{T-L , /C) the space of linear transformations T : Ti. ^ K. 
li K- = % we denote by L{T-L) = L{% , T-L)^ by Ql{%) the group of all invertible operators in L{T-L), 
by L(?^)+ the cone of positive operators and by QKH)^ = Ql{7i)r]L{'H)^. If T G L{'H), we denote 
by (t{T) the spectrum of T, by rkT = dimi?(T) the rank of T, and by trT the trace of T. 

li W C Ti is a subspace we denote by Pw G the orthogonal projection onto W. Given 

X , y € Ti we denote by x (8> ?/ G -^(^) the rank one operator given hy x ^ y {z) = {z , y) x for every 
z G H. Note that if ||x|| = 1 then x (8) x = Pspa.n{x} ■ 

By fixing orthonormal basis's (ONB's) of the Hilbert spaces involved, we shall identify operators 
with matrices, using the following notations: by Mn,d{C) ^ L(C'^ , C") we denote the space of 
complex nxd matrices. If n = d we write A4d{C) = Add^iC) ; 'H{d) is the M-subspace of selfadjoint 
matrices, Ql{d) the group of all invertible elements of A^rf(C), U{d) the group of unitary matrices 
in A4d{C), A4d{C)~^ the cone of positive semidefinite matrices, and Ql{d)^ = A4d{C)^ riGl{d). 

Given S G A^rf(C)"'", we write X{S) = X^{S) G (M>q)-'' the vector of eigenvalues of - counting 
multiplicities - arranged in decreasing order. Similarly we denote by A^(/S') G (M>q)^ the reverse 
ordered vector of eigenvalues of S. If A = (Aj)jgn^ G M>q (not necessarily ordered), a system 
B = {/ijjjgi^ C is a "ONE of eigenvectors for S, A" if it is an orthonormal basis for such 
that S hi = Xi hi for every i G 1^ . In other words, an orthonormal basis 

B = {/ijjigi^ is a "ONB of eigenvectors for 5 , A" <^=^ S = Xi-hi®hi . (1) 
2.2 Basic framework of finite frames 

In what follows we consider (n, (i)-frames. See [3l [101 ESI E31 [30] for detailed expositions of several 
aspects of this notion. 

Let d,n G N, with d < n. Fix a Hilbert space % = C^. A family J" = {fi}iei„ G "H" is an 
(n, (i)-frame for Ti if there exist constants A,B > such that 

n 

A\\xf <'^\{x,fi)\^ < B\\xf for every x e U . (2) 

The frame bounds, denoted by Ajr,Bjr are the optimal constants in ([2]). If Ajr = Bjr we call 
F a tight frame. Since d\ml-i < oo, a family = {/j}iGi„ is an (n,(i)-frame if and only if 
span{/j : i G !„} = T~L- We shall denote by F = F(n , d) the set of all (n, (i)-frames for %. 

Given J" = {/i}igi„ G the operator Tj- G L{H , C") defined by 

Tjrx = ( (x , fi) ) .gjj^ , for every x (^U (3) 

is the analysis operator of Its adjoint G L(C" , %) is called the synthesis operator and is 
given by T^f = Xliein ^« every ti = (t>j)jgi^ G C". The frame operator of /" is 

Notice that, if 7^ = {/j}iGi„ £ then {Sj^x, x) = X]jei„ I ' /*) I every x £ T-L. Hence, 
T G F(n, d) if and only if Sjr G Gl{T-L)^ and in this case j4jr||x|p < {Sj^x, x) < ||x|p for 
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every x ^ Ti. In particular, Ajr = Amin('S'j") = \\Sjr \\ ^ and Xma.x{Sj^) = \\Sjr\\ = Bjr . Moreover, 
F is tight if and only if 5jr = ^ , where r = tr S'j- = Yjiei,, • 

In their seminal work [3], Benedetto and Fickus introduced a functional defined, the so-called frame 
potential, given by 

FP({/,},enJ =E.,,6iJ(/., 

One of their major results shows that tight unit norm frames - which form an important class of 
frames because of their simple reconstruction formulas - can be characterized as (local) minimizers 
of this functional among unit norm frames. Since then, there has been interest in (local) minimizers 
of the frame potential within certain classes of frames, since such minimizers can be considered as 
natural substitutes of tight frames (see [HI [301 [31] ) . Notice that, given F = {/i}iGi„ € "H" then 
FP [F] = tr S'jr = Ylieid ^ii^^Y'- These remarks have motivated the definition of general convex 
potentials as follows: 

Definition 2.1. Let us denote by 

Conv(M>o) = {/ : [0 , cxo) — > [0 , oo) : / is a convex function } 

and ConVs(M>o) = {/ € Conv(IR>o) : / is strictly convex }. Following [30] we consider the 
(generalized) convex potential Pf associated to any / € Conv(IR>o), given by 

Pf{F) =tr/(5^) = E.a,/(A.(5^)) for = {/J.^i^ G , 
where the matrix f{Sj^) is defined by means of the usual functional calculus. A 

As shown in [30, Sec. 4] these convex potentials (which are related with the so-called entropic 
measures of frames) share many properties with the BF-frame potential. Indeed, under certain 
restrictions both the spectral and geometric structures of minimizers of these potentials coincide 
(see [303 and Remark 15.61 below) . 

Remark 2.2. The results that we shall develop in this work apply in the case of convex potentials 
Pf for any / E ConVs(M>o). Notice that this formulation does not formally include the Mean 
Square Error (MSE), which is the convex potential associated with the strictly convex function 
/ : (0,00) — )• (0, cxo) given by f{x) = x~^, since / is not defined in in this case. In order to 
include the MSE within our results we proceed as follows: we define / : [0, 00) — )• (0, 00] given by 
f{x) = x~^ for X > and /(O) = 00. Assuming that x < 00 and x-|-oo = x- oo = oofor every 
X G (0 , 00), it turns out that the new map / is a (extended) strictly convex function and all the 
results obtained in this paper apply to the convex potential induced by /. A 

2.3 Submajorization 

Next we briefly describe submajorization, a notion from matrix analysis theory that will be used 
throughout the paper. For a detailed exposition of submajorization see [1]. 

Given x, y £ we say that x is submajorized by y, and write x -<w y, if 

S ^ Yl Hi every k £ld ■ 

i=l 1=1 

If X y and tr x = Yli=i ~ Z^iLi Vi = try, then we say that x is majorized by y, and write 
X < y. In case that x ^ y but y 7^ x we say that y majorizes x strictly. If the two vectors x and 
y have different sizes, we write x ^ y if the extended vectors (completing with zeros to have the 
same size) satisfy the previous relationship. 



5 



On the other hand we write x if Xi < yi for every i G . It is a standard exercise to show that 
X ^y x-^ ^ y-^ =^ X -<y, y. Majorization is usually considered because of its relation with 

tracial inequalities for convex functions. Indeed, if we let x, y ^ M*^ and let / C R be an interval 
such that X, y ^ I'^ then (see for example [3]): 

dcf 

1. X ~< y <^ tr f{x) = fi^i) ^ fiVi) — f{y) for every convex function / : / — > R. 

1=1 i=l 

2. If only X -Kw y, but the map / : / ^ R is convex and increasing, then tr/(x) < tr/(y). 

3. If X y and /:/—)• R is a strictly convex function such that tr f{x) = tr f(y) then there 
exists a permutation a of such that yi = x^-^j) for z € 1^ . 

As a consequence of item 3. above, ii x ~< y strictly and / : / — t- R is a strictly convex function 
then tr f{x) < tr /(y): indeed, if tr f{x) = tr f{y) then by item 3. above we would have that 
Hi = Xcr(i), i G Id , for a permutation a of and hence that y ^ x. 

The notion of vector submajorization can be extended to a preorder between selfadjoint matrices 
as follows: given Si , S'2 G 7i{d) we say that is submajorized by S2 , and write S2 (resp. 

Si ^ S2) if A(S'i) A(52) (resp. A(S'i) ^ A(5'2), i.e. Si S2 and tr Si = tr S2). 

Remark 2.3. Majorization between vectors in R'^ is intimately related with the class of doubly 
stochastic d x d matrices, denoted by DS((i). Recall that a d x d matrix D G DS((i) if it has non- 
negative entries and each row sum and column sum equals 1. It is well known (see [1]) that given 
X , ?/ G R'^ then x ^ y if and only if there exists D G DS((i) such that Dy = x. As a consequence 
of this fact we see that if xi , yi G R** and X2 , 2/2 S are such that 

Xi ^ for i = l,2 =^ x = [xi , X2) < y = {yi , ^2) in R'"+'* . (4) 

Indeed, if Di and D2 are the doubly stochastic matrices corresponding the previous majorization 
relations then D = Di® D2 G DS(r + s) is such that Dy = x. A 

3 Optimal completions with prescribed norms 

In this section we give a detailed description of the optimal completion problem and recall some 
notions and results from our previous work |33t 134] . in a way suitable for the exposition of the 
results herein. In particular, the exposition of the results in Section [3.31 differs from that of j34] . 
since this new presentation is better suited for our present purposes. 

3.1 Presentation of the problem 

In several applied situations it is desired to construct a sequence Q in such a way that the frame 
operator of Q is given by some B G A^rf(C)''' and the squared norms of the frame elements are 
prescribed by a sequence of positive numbers a = {ai)i^i^, G R^g • That is, given a fixed B G 
Alrf(C)+ and a G R^g ; we analyze the existence (and construction) of a sequence Q = {gijigij. such 
that Sg = B and ||5i|p = Oi , for i G 1^ . This is known as the classical frame design problem. It 
has been treated by several research groups (see for example [21 |8l |TT1 [131 El [13 [121 [26] )• In what 
follows we recall a solution of the classical frame design problem in the finite dimensional setting, 
in the way that it is convenient for our analysis. 

Proposition 3.1 ([2l[29]). Let B G Md{C)+ with X{B) G (M|o)^ and let a = (ai)iei, G R^Lq • Then 
there exists a sequence Q = {gi}i^j^ G T-L^ with frame operator Sg = B and such that Hfl'ilP = ai 
for every i G Ifc if and only if a ^ A(i3) (completing with zeros if A; ^ d). □ 



6 



Recently, researchers have made a step forward in the classical frame design problem and have 
asked about the structure of optimal frames with prescribed parameters. Indeed, consider the 
following problem posed in [20j: let n = and let Tq = {/i}iei„„ e be a fixed (finite) 
sequence of vectors. Consider a sequence a = {ai)i^i^ G M^g such that vkSj^^ > d — k and denote 
hy n = + k. Then, with this fixed data, the problem is to construct a sequence 

G = {ai}ielk G 'H'' with WgiW"^ = a.; for i G Ifc , 

such that the resulting completed sequence F = (Jo ; G) G F(n , d) - obtained by juxtaposition of 
the two finite sequences - is a frame whose MSE, given by tr 5"^^, is minimal among all possible 
such completions. 

Note that there are other possible ways to measure robustness (optimality) of the completed frame J- 
as above. For example, we can consider optimal (minimizing) completions, with prescribed norms, 
for the Benedetto-Fickus' potential. In this case we search for a frame J- = {J-q , Q) G F(n, d), 
with ll^ilP = ai for i G Ifc, and such that its frame potential FP {T) = tr S'jr is minimal among all 
possible such completions (indeed, this problem has been considered before in the particular case in 
which Fq = in [3l [HI [22l [25l [30] ) . More generally, we can measure robustness of the completed 
frame J- = {J-q,Q) in terms of general convex potentials (see Definition 12. ip . 

In order to describe the main problems we first fix the notation that we shall use throughout the 
paper. 

Definition 3.2. Let Jb = {/i}iei„o S 7^"° and a = {ai)i(zi^ G (M^g)^ such that d - rk^j-Q < k. 
Define n = + k. Then 

1. In what follows we say that {J-q , a) are initial data for the completion problem (CP). 

2. For these data we consider the sets 

Ca{Fo) = { {Tq,0) G "H" : g = {giliGlfe and H^ilp = for i G Ifc} , 
and SC^iTo) = {S^ : C^{To)} C Md{C)+ . 

When the initial data (Jq , a) are fixed, we shall use the notations 5*0 = Sj^^ and A = A^(S'o) . 

We remark that we shall use the vector A = A^(So) instead of A~''(5o) for convenience (see the 
comments at the beginning of Section [3]). A 

Main problems: (Optimal completions with prescribed norms for majorization) Let (J"o , sl) be 
initial data for the CP and let / G ConVs(M>o). 

PI. Give an explicit description (both spectral and geometrical) of G Ca{J^o) that are the 
minimizers of Pj in Ca{J~o)- 

P2. Construct a fast algorithm that efficiently computes all possible J- G Ca(^o) that are the 
minimizers of Pj in CaiJ~o)- 

P3. Verify that the set of G Ca(^o) that are the minimizers of Pj in Ca{J~o) is the same for 
every / G ConVs(]R>o). 

A 

In previous works we have obtained some results related with the problems above. Indeed, in [33j 
we obtained a partial affirmative answer to P3, while in [3jy we obtained some partial results related 
with PI. and a non-efficient algorithm as in P2. that worked in small examples (see Sections 13.21 
and 13.31 below). 

In this paper, building on our previous work, we completely solve the three problems above in 
terms of a constructive (algorithmic) approach. 
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3.2 On the structure of the minimizers of Pf on C^iJ^o) 

In this section we collect results of [3l] that we shall use in this paper. Throughout this section 
we fix the initial data (J-q , a) for the CP. Notice that we are using the following convention in 
Definition 13.21 we denote A = X^^Sj^g) G M*^, i.e. arranged in non-decreasing order. Thus we recast 
the results from [34] using this convention. Also notice that we are assuming that a = £ M'^. 

Our analysis of the completed frames T = {Tq , Q) depends on T through Sjr = Sjr^^ + Sg . Hence, 
the following description of 5Ca(^o) plays a central role in our approach. 

Proposition 3.3. Let (J-q , a) be initial data for the CP. Then 

5Ca(Jo) = {S€ Md{C)+ : S>Sto and a ^ A(5 - . □ 

Let /u G (M^q)-'- be such that a ^ /i, and let 

Ca(Jo , = {-F = (-^0 , G) G Ca(Jo) : HSg) = /i} C Ca(Jo) . 
By Proposition 13.31 we get the following partition: 

Ca(-Fo) = U Wo , Ai) where Td{a) = G (M^q)^ : a ^ ^} . 

Merd(a) ^ ' 

Building on Lidskii's inequality (see [4, IIL4]) we obtained the following result: 

Theorem 3.4. Consider the previous notations and fix ^ = /U"^ G rrf(a). Then, 

1. The set A(Ca(^o , m)) = {-^('S'j^) '■ ^ € CJyT^ , fi)} is convex. 

2. Let u = X^{Sjrg) + Then is a ^-minimizer in A(Ca(.Fo , /i)). 

3. If J" = (J"o 7 Q) G Ca(^o ; /^) is such that \{Sjr) = then Sj^q and Sg commute. □ 

Remark 3.5. Consider the previous notations and fix = /x-'- G rrf(a). Let / G ConVs(]R>o) and 
let Pf be the convex potential induced by /. By the results described in Section [2^ and Theorem 
13.41 we see that, if A = A^(S'jrJ then 

F G argmin{Pj(J-') : F' G C^{F^ , ^ A(S^) = (A + /i)^ = ( A^ + f . (6) 

That is, if we consider the partition of Ca(^o) described in Eq. ([5]), then in each slice C^iF^ , ^) 
the minimizers of the potential Pj are characterized by the spectral condition ([6|) . This shows that 
in order to search for global minimizers of Pf on Ca(^o) we can restrict our attention to the set 

C°P(7-o) {F= (Fo , G) G Ca(J-o) : A(5^) = ( A^^^J + X^Sg) ^ } . (7) 

Indeed, Eqs. ([5]) and ^ show that if J" is a minimizer of Pf in Ca{Fo) then F G Ca^(J-o). Since 
the potential Pf{F) depends on F through the eigenvalues of Sjr we introduce the sets 

5(C°P(J-o)) {Sj: 7-gC°p(7-o)} and A(C°p(J-o)) {A(5^) : F eC^{F,)} . (8) 
Finally, for any A G M^q , in what follows we shall also consider the set 

A°P(A) = {A^ + /X : ^ G rd(a)} = {A^ + //^ : G M^q and a ^ ^} . (9) 

A 

Theorem 3.6. Let {Fq , a) be initial data for the CP. Denote by A = A^(S'j-jj). Then 
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1. The set Aa^(A) is compact and convex. 

2. The spectral picture A{C^^{To) ) = {u^ : 

3. If J" = (7"o ) Q) S Ca^(-Fo), with \^{Sg) = /X, then there exists {vi : i ^ Id} an ONB of 
eigenvectors for Sj^^-^ , A such that 

Sg = Hi ■ Vi iSi Vi and 5'jr = Sjr^^ + Sg = {Xi + m) Vi®Vi . □ 

i&d i&d 

For every / G Conv(M>o) we consider the convex map 

F:Wi^^R given by ^(7) = tr 7(7) = ^ /(7,) , for 76 M^q ■ (10) 

Theorem 3.7. Let (J-q , a) be initial data for the CP and let / € ConVs(M>o). Then there exists 
a vector fif{X,a.) = fj, = fj,^^ ^d{^) such that: 

1. T = (Jo , G) G Ca(^o) is a global minimizer of Pf T € Ca^(/o) and X{Sg) = fi. 

2. If we let A = A^(«S'jrjj) then fi is uniquely determined by the conditions 

G rrf(a) and F{X + fi)= min F(A + 7) = min F(z^) . (11) 

Hence, if we let i^f{X , a) = A+/i/(A , a) then 3 ! argmin {F{x) : x G Aa''(A)} = z^/(A , a). □ 

Theorem 3.8. Let {Tq , a) be initial data for the CP. Let / G ConVs(M>o) and assume that 
F = (/"o , ^) is a global minimizer of Pf on Ca^(/o). Then, there exists a partition {Jijieip of 1^ 
and ci > . . . > Cp > such that 

1. The subfamilies Qi = {fj}je.Ji (for ^ S Ip ) are mutually orthogonal, i.e. Sg = ®i&pSg^ . 

2. The frame operators Sg. and Sj^^^ commute, for every i G Ip . 

3. We have that Sjr fj = Ci fj , for every j G Jj and every z G Ip . 

The statement is still valid if we assume that J- is just a local minimizer, but if we also assume as 
a hypothesis that satisfies item 2 (for example if Sjr^^ =0). □ 

3.3 The feasible case of the CP 

In this section we recall the results from [33j that we shall need in the sequel. Throughout this 
section we fix the initial data (Jx), a) for the CP. Denote by Sq = Sj^^^ , A = A^(5o) and i = tr A+tr a. 
In [33] we introduced the following set 

Ut{So, m) = {So + B: Be Md(C)+ , vkB < d - m , tr (5o + 5) = t } C Md{C)+ , 

where m = d — k. In [331 Theorem 3.12] it is shown that there exist -<-minimizers in C/j(S'o , m). 
Indeed, there exists /i(A , a) G (M>q)-'' - that can be effectively computed by a fast algorithm - 

such that, if i^(A , a) = A + /i(A , a) G M>o then S G Ut{So , m) is a ^-minimizer if and only if 
X{S) = u{X, a)^. 

Notice that by construction i/(A , a) is not a necessarily ordered vector (nor decreasing, nor increas- 
ing); yet, in terms of the terminology from [33], we have that ux^mit) = i^{X, a)^. Thus, we have 
reversed the order of the vector /i(A , a) - accordingly with reversing the order of A = X^{Sjrg) - and 
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we have changed the description of the vector zv(A , a) - while preserving all of their majorization 
properties - with respect to |33] . Nevertheless, we point out that the ordering of the entries of the 
vector i^(A , a) presented here plays a crucial role in simplifying the exposition of the results herein, 
as it guaranties that /i(A , a) = z^(A , a) — A. 

The following definition and remark show the relevance of the notions introduced above for the 
computation of the spectral structure of solutions for the optimal completion problem. 

Definition 3.9. Let [J-q , a) be initial data for the CP with A = A^(S'jrg). We say that the pair 
(A , a) is feasible if /i(A , a) satisfies that a ~< fj,(X , a). A 

Remark 3.10. Let {J-q , a) be initial data for the CP with A = X^{Sj^q). Assume that the pair 
(A , a) is feasible and denote /x = /x(A , a). In this case (see [33]) for any 5 which is a ^-minimizer 
in Ut{So , m) - where ni = d — k - it holds that A(5 — ^o) = fj, and hence, by Proposition 13.31 we 
conclude that S G 5Ca(-^o)- Moreover, Proposition l3.3l also shows that SCaiJ^o) ^ Ut{So , m). Then 
S is also a ^-minimizer in SCa{J~o)- Therefore, as a consequence of the results in Section \2.3\ any 
completion T = (Tq, Q) G Ca(^o) such that Sj: = 5 is a minimizer of Pf for every / G Conv(M>o). 

On the other hand, as a consequence of the geometrical structure of S" = Sjr as above (see [33113^ ). 
we conclude that there exists c > such that Sjr gi = cgi for every i G Efc . That is, in this case the 
structure of the completing sequence Q given in Theorem 13.81 is trivial: the partition of 1^ has only 
one member and there exists a unique constant c = ci . A 



It is worth pointing out that it is easy to construct examples of initial data (J^o ) ^) for the CP 
such that the pair (A, a) is not feasible (see [33]), so that comments in Remark 13.101 do not apply 
in these cases. 

Remark 3.11. Let [J-q , a) be initial data for the CP with k > d (so that m = d — /c < 0), let 

A = \^{Sjr^,) and let t = tr a + tr A. In [33] we shown that there are two cases: 

1. Since A = A^ then A^ = max {Aj : i G Id} ■ If 

t tra + tr A then A^^l, = KA,a). (12) 

ad d 

2. If Ad > ^ then there exists s G I^-i such that 

z/(A , a) = (els , As+i , . . . , Arf) with A^ < c < A^+i (13) 
so that A ^ v{\ , a) = u[\ , a)^, and in this case the index s also satisfies that 
1 " 

c = — [ tr a + Aj ] so that tr v{\ , a) = t = tr A + tr a . 

^ i=i 



In what follows we obtain an explicit description of the vector v{\ , a) in case d < k (so that m < 0) 
and ^ [ tr a + tr A ] < Arf . Explicitly, we compute the parameters s and c of Eq. (fT3]) in a way that 
is key for the developments of Section HI Our present techniques differ substantially from those 
introduced in |33j . We begin by showing that the vector j^(A, a) above is unique. Then, we show 
that the computation of z^(A , a) for m G I^-i can be reduced to the case when m = 0. First we 
need to introduce some notations: A 

Definition 3.12. Let {J-q , a) be initial data for the CP. Assume that d < k. We denote by 
A = X^{Sjrg) and hi = Xi + Ui for every i G Irf . 
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Given j , r € 1^ U {0} such that j < r, by Qj ,r we denote the final averages: 

^ r k 1 ^ 



i=j+l i—r+1 i=j+l i=j+l 

We shall abbreviate Qr = Qo ,r ■ A 
Lemma 3.13. Let (J-q , a) be initial data for the CP with k > d. Let r G 1^ . Then 

1. If r < d and Qr < A,.+i then Qr < Qj , for every j such that r < j < d. 

2. If r < d and Qr < A^+i then Qr < Qj , for every j such that r < j < d. 

3. If Xr < Qr then Qr < Qj , for every j such that 1 < j < r. 

Proof. Denote by c = for a fixed r < d. Recall that A = A^. If j > r then 



if " ^ \ 1 

c < \r+i =^ = - tr a + ^ Ai + ^ Xi \ > - {r c + {j - r) c) 

V i=l i=r+l j 

The proof of item 2 is identical. On the other side, if j < r then 

\ i \ 1 

Ar < c ^ = - tr a + V Ai - V Ai > - ( r c - (r - j) c ) = c . □ 



tra + ^A.- E ^0 ^7 

i=i i=j+i j 



Proposition 3.14. Let {Tq , a) he initial data for the CP with k > d (so that m < 0) and assume 
t/iat ^ [tr a + tr A ]< Arf. Then 

1. There exists a unique index s € 1^ such that A^, < Qs < A^+i , and in this case 

s = max {w G Id-i : Qw = min Qj } and v{\ , a) = (Q^ 1^ , A^+i , . . . , A^) (15) 

2. If another index r G I^-i satisfies that Xr < Qr < A^+i , then 

(a) Qr = min Qj = Qg and r < s. 

(h) If r < s, then Qr = Xr+i = Xs and also z/(A , a) = {Qr Ir , Xr+i , ■ ■ ■ , A^). 

3. Civen p = (clj, , Ar-+i , • • • , X^j (or p = old) such that X^p = p^ and tr p = tr u{X, a) 
then p = z/(A , a). 

Proof. The existence of an index s such as in item 1 is guaranteed by the properties of u{X , a) 
stated in [33]. Nevertheless, it is easy to see that the index s described in Eq. ([15]) satisfies that 
Xs < Qs < As+i . The formula given in Eq. (|15p . which shows the uniqueness of z^(A , a), is a 
direct consequence of Lemma 13.131 Assume that A^ < Qr ^ A^+i . Then Qr = min Qj = Qs and 

r < s by Lemma [3. 131 If r < s, then Qs = \ [r Qr + Yll=r+i '^i) ~ Qr ■ This clearly implies all the 
equalities of item (b). Finally, observe that item 2 =^ item 3. □ 

Remark 3.15. Let [Tq , a) be initial data for the CP with m = d — k > 0. Then if 

A = (Ai, ... , Afe) G (M'^)^ then zy(A , a) = A , a) , A^+i , . . . , A^) , (16) 
and i^( A , a) is constructed as in Proposition 13.141 

The proof is direct by observing that, extracting the entries A^+i , . . . , Xd of the vector z/(A , a) 
as described in [33\ Def. 4.13], the vector that one obtains (with the reverse order) satisfies the 
conditions of item 3 of Proposition 13.141 relative to the pair ( A , a) . A 
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The following result is in a sense a converse to Remark 13.101 It establishes that if there exists 
/ E ConVs(M>o) and a minimizer T = [Tq^Q) of in Ca(J^o) such that the structure of the 
completing sequence Q as described in Theorem 13.81 is trivial, the the underlying pair (A , a) is 
feasible. Recall the notation i^f{X, a) given in Theorem 13. 7[ 

Lemma 3.16. Let (J-q , a) be initial data for the CP , k > d, and let T = (J-q , ^) € Ca^(J-o) he a 
minimum for Pj on Ca(^o) for a f G ConVs(M>o). Suppose that, for some c> 0, 

W = R{Sg)^n and 5^|^ G L(l^) = c% • 

Let A = A^(S'j-g), fi = X^(Sg) and s = dim W = max{f £ld : fJ-i ^ 0}. Then 

As < c < \s+i so that (A , a) is feasible and z^/(A , a) = iy{X , a) . 

The same final conclusion trivially holds if s = dim W = d and Sjr = cL. 

Proof. Suppose that s < d. By hypothesis z^/(A, a) = A^ + /i"^ = (cl^ , A^+i , . . . , A^) and it 
satisfies that A(S'jr) = i/f{X , a)^. Since a ^ /i = //^ then tr /u = tr a > "^^^i Oi , because s < d < k. 
Suppose now that c > Xs+i ■ For small t > consider the vector 

-f{t) = {cls-i, {c-t), X,+i + t, Xs+2, ... , Xd) with tr 7(t) = tr S*^ . 

Let = 7(t) — A. For every t we have that tr = tr fi. On the other hand, if 

t<Y ^ ^(t) = (/ii , . . . , Hs-i, fis-t,t,01d-s-i)=Kt)^ e{Rio)K 

It is easy to see that if also t < J2i=s+i then still a ~< fi{t). So there exists T' € Ca^{To) 
such that X{Sjr') = 'j{t)'^. Notice that, since {c — t , Xg+i + t) ^ (c, A^+i) strictly, then Pf[F') = 
tr f{"f{t) ) < tr f{uf{X , a) ) = Pf{F), a contradiction. Hence c < A^+i . 

The condition Xg < c follows from the fact that c — A^ = /is > 0. These facts show that A = 
At ^ i/j(A , a) = VfiX , a)t =^ iyf{X , a) = i/(A , a) (by item 3 of Proposition 13. 14p . In particular, 
a ~< X{Sg) = /U = ^{X , a) — A = fj,{X , a) so that (A , a) is feasible. □ 

4 Uniqueness and characterization of the minimum 

In this section we shall state the main results of th paper. For the sake of clarity of the exposition, 
we postpone the more technical proofs until Section 5. 

4.1 (Fixed data, notations and terminolgy). Let (J-q , a) be initial data for the CP. Until Theorem 
14.81 we shall assume that k > d, so that m = d — k < 0. Recall that 

= {T= (To , G) e Wo) : X{Sr) = ( At(5^J + xHSg) )^ } . 
Fix / G ConVs(]R>o) and a minimizer T = {Pq , G) € CaiPo) be for Pf on Ca{Po). 

1. By Theorem 13. 7t we know that P G Ca^{Po) and, if we denote by A = X^{Sj^f,), then X^{Sg) = 
^JLf{X , a) = i^/(A , a) — A. By Theorem 13.61 there exists {uj : i G 1^} an ONB of eigenvectors 
for , A such that 

5*5 = ^ /Xj • fj (g) and Sjr = ^jr^ + S'g = ^ (Aj + /ij) Vi®Vi . (17) 

2. Let sjr = max {i £ : fj^i 0} = rkSg . Denote hy W = R{Sg), which reduces Sjr . 



12 



3. Let S = Sjr\yy € L{W) and (7{S) = {ci , . . . , Cp} (where ci > C2 > • • • > Cp > 0). 

4. Let Kj = {i G I^jf '■ K + IJ'i = Cj} and Jj = {i G Ifc : S (7i = cj Qi}. By Theorem 13.81 

= U Kj and Ifc = U Jj ■ 

j&p j&p 

Observe that sj^ , X = A^(S'j-(,) and the sets Kj completely describe the vector = X{Sg). 

5. Since R{Sg) = spanj^fj : i £ 1^} = W = (Bi^ip ker (5 — Cj IvF ) then for every j € Ip , 

Wj = span{(7j : i G Jj} = ker (5 — Cj Iw ) = span{?;j : i £ Kj} , (18) 

because gi G ker (S" — Cj Iw ) for every i £ Jj . Note that, by Theorem 13.81 each Wj reduces 
both 5j-y and Sg . 

6. If p = 1 then Ji = 1^ and S = ci Iw ■ Hence the minimum satisfies the hypothesis of 
Lemma 13.161 so that the pair (A , a) is feasible. 

7. We denote by hi = Xi + ai for every i G Id . Given j , r G 1^ such that j < r, let 

Pj ,r = r— r / hi = — — r / Aj + ttj , 

r — 7 + 1 r — 7 + 1 

be the initial averages. We abbreviate Pi = Pr ■ A 

Remark 4.2 (A reduction procedure). Consider the data, notations and terminology fixed in 14.11 
For any j G Ip-i denote by 

=Ia\\j K, , Lj =h\[J J^ , A^-^') = (A,)ig/, , Qj = {gi)i^L, , a(^^) = {a.i),^L, 

i<j i<j 

and take some sequence in Hj = [ ®i<jWi]'^ such that •S'^u) = 'S'ol'Hj (notice that, by 
construction, 71 j reduces So). 

Then, it is straightforward to show that Tj = {J-q^ , Qj) is a (global) minimizer of Pf on Caj{J^Q^) 
in T-Lj , i.e. an optimal completion for the reduced problem. Indeed, recall that the minimality is 
computed in terms of the map F defined in Eq. (jlOp , which works independently in each entry of 
X{S^) = iyf{X,^)K 

The importance of the previous remarks lies in the fact that they provide a powerful reduction 
method to compute the structure of the sets Qi , Ki and Jj for i G Ip as well as the set of constants 
ci > . . . > Cp > 0. Indeed, assume that we are able to describe the sets Qi , Ki , Ji and the constant 
ci in some structural sense, using the fact that these sets are extremal (e.g. these sets are built on 
ci > Cj for 2 < j < p). 

Then, in principle, we could apply these structural arguments to find G2 , K2 , J2 and the constant 
C2 , using the fact that these are now extremal sets of Ti , which is a Pf minimizer of the reduced 
CP for (J-'q^\ a^^)). On the other hand, the minimality of the final reduction J-p-i produces a 
pair (A^^~^^ , a^^~^)) which must be feasible by item 6 of I4.H because it has an unique constant 
Cp associated to the unique set Kp . As we shall see, this strategy can be implemented to obtain 
(inductively) a precise description of the sets above. A 

Remark 4.3. Let {Tq , a) be initial data for the CP with d < k, X = A^(5j-y) and a = sl^. Fix 
/ G ConVs(M>o) and let T = {Tq , Q) G C'^{Fq) be a global minimum for Pf on C^[Fq). In section 
15.11 we shall prove the following properties (conjectured in [M]) of the sets Jj and Kj defined in 
item 4. of 14.11 describing Hf{X, a) and i^f{X, a): 
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1. Each set Jj and Kj consists of consecutive indexes, for j G Ip . 

2. The sets Kj and Jj have the same number of elements, for j G \-i ■ 

3. Moreover, Ji < . . . < Jp (i.e. if / G Jj and h G Jj with i < j ^ I < h) and < . . . < Kp. 
In particular, by items 1 and 2 above, Kj = Jj for j G Ip_i . 



A 



We state the properties of the sets Jj and Kj, j G !„ described in Remark 14.31 in the following: 



Theorem 4.4. Let (J-q , a) be initial data for the CP with d < k. With the notations of Remark 
T3l assume that A = X^{Sjrg), ji = ji^ = ^/(A , a) and a = a^. Then 

1. There exist = sq < si < S2 < • • • < Sp_i < Sp = sjr = max{j G 1^ : /ij ^ 0} such that 
Kj = Jj = {sj^i + l, ... , Sj} , , for j G Ip_i , 
Kp = {sp-i + 1 , . . . , Sp} , Jp = {sp-i + 1 , . . . , A:} . 

2. The vector Vf{\ , a) = ( ci l^^ , . . . , Cp , A^^+i , . . . , A^ ) , where 



^ hi = Ps^_^+i,sr for rGl 



Sr-l . 



■p— 1 ) 



or also Cr = \j + /ij for every j & Kr = Jr for r G Ip_i . 

3. The constant Cp is the one defined by the feasible final part i.e., Cp = Qsp-i ,sp and the indexes 
Sp_i and Sp are determined by the last block (recall Lemma l3.16p . 

Proof. See Section [221 D 

Let (J^o ) ^) be initial data for the CP. Assume that i^/(A , a) = ( ci 1^^ , • • • , A^^+i , . . . , X^^ i.e. 
with p = 1, in the notations of Theorem 14.41 Then, by Lemma 13.161 the pair (A , a) is feasible and 
a) = u{X, a). 

In what follows we shall need the following notion, that allow us to show feasibility in the more 
general case in which, in the notations of Theorem 14.41 p > 1. 

Definition 4.5. Let (Jq > a) be initial data for the CP. Let A = A''"(5'jr^) g (M^q)^- Suppose that 
k > d. Given s G Id-i denote by 

A^ = (A,+i , . . . , Ad) G M'^-^ and a^ = (a,+i , . . . , a^) G M^^^ , 

the truncations of the original vectors A and a. We say that the index s is feasible if the pair 
(A'^ , a'') is feasible for the CP. Note that {d — s) — {k — s) = d — k = m < 0. Therefore 

i^s = i^(A'' , a*) ^ {clr-s , Ar+i , ... , Xd) where c = Qs,r 

for the unique r > s such that A^ < c < A^+i (or Vs = Qs,d^d-s if ^d < Qs,d)- This means that 
Xs^Us^iR''-')^. ' ' A 

By Remark 14.21 and Lemma [3.16l we know that, with the notations of l4.1l the index Sp_i associated 
to the minimum = z^j(A , a) is feasible - in the sense of Definition 14.51 - because the last block of 
u is constructed with the final feasible parts of A and a, and i^sp_i = ( Cp lsp-sp_i , A^^+i , . . . , A^) . 

Proposition 4.6. Let (Tq , a) be initial data for the CP. With the notations of Theorem 14- 41 the 
global minimum Vf{X, a) satisfies that 
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1. The index Sp-i (where the feasible part begins) is determined by 

Sp-i = min { s € Irf : s is feasible } . 

2. The following recursive method allow to describe the vector z^/(A, a) as in Theorem \4-4\ 

(a) The index si = max {j < Sp_i : Pi^j = max Pi^i }, and ci = Pi^si ■ 

(b) If the index sj is already computed and Sj < , then 

Sj+i = max {sj < r < Sp-i : Ps^+i J = max Ps,+i,i} and Cj+i = P^.+i , • 

Sj <i<Sp_i 

Proof. See Propositions 15.1^ and [STTTl □ 

The following are the main results of the paper. In order to state them, we introduce the spectral 
picture of the completions with prescribed norms, given by 

Theorem 4.7. Let (J-q , a) be initial data for the CP with m = d — k < 0. Then the vector 
V = ^'/(A , a) is the same for every f E ConVs(M>o). Therefore, 

e A(Ca(^o) ) and < for every 7 G K{C^{Tq) ) . (19) 

Proof. By Proposition 14.61 the minima v = z/j(A, a) are completely characterized by the data 
(A , a) without interference of the map /. Therefore, given any 7 G A(Ca(.7x)))) 

tr f{i') < tr 7(7) for every / € ConVs(M>o) =^ 1/ -< 7 . □ 

The following result shows that the structure of optimal completions in Ca(.7^o) in case m = d—k > 
can be obtained from the case in which m = 0. 

Theorem 4.8. Let (J^q , a) be initial data for the CP with m = d — k > 0. If we let 

A' = (Ai , . . . , Afe) G (R^o)^ tf^en Vf{\ , a) = {vf{M , a) , A^+i , . . . , A^) , 

where Vf{\' , a) is constructed as in Proposition \4.6\ (since d' = k, by construction of X' G (M>g)^j. 
In this case the vector J^/(A, a) is the same for every f G ConVs(M>o) and also satisfies Eq. (jl9p . 

Proof. Since k = d — m and a G we deduce that any 6 = 6^^ M>g such that a ^ 6 must have 
6k+i = . . . = 6d = 0. It is easy to see that this fact implies that 

A°P(A) = {X^ + 5^: 5 G and a ^ (5} = {(7 , A^+i , . . . , A^) : 7 G A°p(A')} (20) 

We know that Uf{X , a) — X = ^ = and that a ^ /x fJ-k+i = ■ ■ ■ = l^d = 0. Recall the map 
F : M defined in Eq. 1^ for each / G ConVs(M>o). Therefore 

i./(A, a) G A°P(A) and i/^(A , a) = /i-^ + A^ ^ i//(A , a) = (p , A^+i , . . . , A^) , (21) 
for some p G A°^iX'). Then F{uf{X , a) ) = F{p) + F{Xk+i , . . . , A^). By Eq. 

+ F(Afc+i , ... , Xd) . 



F(i^/(A,a)) = mm F(i/) = 
i/eAa^(A) 



min F(y) 
7GA°P(A') 



Using Eq. (fTT|) again we deduce that p = i^f{X' , a). Since z^/(A' , a) is constructed as in Proposition 
4:.6\ then it is the same vector for every strictly convex map / and the same happens with i^/(A , a), 
so that i^/(A , a)'^ is a minimum for majorization on A(Ca(^o) )• D 

Remark 4.9. The construction of the minimum i^f{X, a) given by Proposition 14.61 is algorithmic, 
an it can be easily implemented in Mathlab. It only depends on - an already available, see ^3] - 
routine for checking feasibility, which is fast and efficient. A 
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5 Proofs of some technical results. 

In this section we present detailed proofs of several statements in section [H All these results assume 
that the initial data {J-q , a) for the CP satisfies that k > d. As already explained, the general case 
can be reduced to this situation. 

5.1 Description of the sets Ki and Jj . 

5.1. We begin by recalling the notations of 14.11 Let (J-q , a) be initial data for the CP, with k > d. 
Fix a convex map / G ConVs(M>o). We consider the following objects: 

1. Let T = (J-Q , 0) € Ca^(J-o) be a global minimum for Pj on Ca^(Jx)) (or a local minimum 
if To = 0). If A = A^(S'j-g) and /u = \^{Sg), then there exists {uj : i G 1^} an ONB of 
eigenvectors for SJr^^ , A such that 

Sg = Hi - Vi®Vi and Sjr = Sjr^+ Sg = (Aj + m) Vi®Vi . 

- max{i G Irf : / 0} = rk S'g . Denote hy W = R{Sg), which reduces Sjr . 
Sjr\y^ G L{W) and a{S) = {ci , . . . , Cp} (where ci > C2 > • • • > Cp). 
= {i G Is : Aj + /ij = Cj} and Jj = {i £ Ik : S Qi = Cj gi} . Then 

I,^ = U Kj and Ifc = U Jk . 

j&p feGlp 

We remark that, if J^q = 0, these facts are still valid for local minima by Theorem 13.81 The next 
three Propositions give a complete proof of Theorem 14.41 The first of them justifies the convention 
that A = A^(S'j-J. A 

Proposition 5.2. Let {J-q , a) be initial data for the CP with A = A^(5jry), and consider the 
notations of \5.1\ If p > 1, then 

i G Ki =^ i < j i =^ Ai < Xj ) for every j G U Kj. = hjr \ Ki . 

Inductively, hy means of Remark \4-^ we deduce that all sets Kj consist on consecutive indexes, 
and that Ki < Kj ( in terms of their elements ) if i < j. 

Proof. Suppose that there are i G -fCi and j G Kr (for some r > 1) such that j < i. Then Xj < Aj 
and /Xj < fj,j . For t > very small, let Hi{t) = — t > and iJ,j{t) = fij + 1. Consider the vector 
/i(t) obtained by changing in /i the entries fii by fJ-i{t) and fij by Hj{t). Observe that not necessarily 
fi{t) = fi{t)^, but we are indeed sure that ci > Cr ■ 

Nevertheless, by Remark 12.31 (/ij , Hj) -< {fJ-i{t) , fij{t) ) =^ a ^ /i -< iJ,{t). Therefore there exists 
T' = (J"o , G') G Ca(-Fo) such that, using the ONB of Eq. 1^, 

Sg' = E l^hit) ■ Vh ® Vh and Sjr> = Sjr^ + Sg> = Yl {>^h + fJ-hit)) Vh ® Vh ■ 

Denote hy V = span{fj , Vj}, which reduces both Sjr and Sj^, . Also Sjr,\y± = Sjr\y± . Considering 
the restrictions to V as operators in L{V) = A^2(C) we get that 

KS^'lv) = (Aj + /xi(t) , Xj + fj,j{t) ) = {ci - t , Cr +t) ~< {ci , Cr) = X{Sjr\v) strictly , 



2. Let sjr = 

3. Let S = 

4. Let Ki -- 
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for t small enough in such a way that ci — t > Cr + t, so that (ci — t , + t) = (ci — t , + t)^. 
Then the map F of Eq. (|lUp . considered both on M?,q and M>g , satisfies that 



F{X{S^,\v)) <F{XiSMv)) =^ PfiF') = F{XiS^,)) <FiXiS^))=PfiF) , 
a contradiction. The inductive argument follows from Remark 14. 2 [ 



□ 



5.3. In the following two statements we assume that, for some / € ConVs(M>o), the sequence 
F = {Fq , G) £ Ca^{Fo) is a global minimum for Pj , or it is a local minimum if Sjr^ = and A = 0. 
In both cases I5.ll applies. A 

Proposition 5.4. Let (Fq , a) be initial data for the CP, and let F = {Fq , Q) € C^{Fo) as in \5.1\ 
and \5.S[ Suppose that p > 1. Given h £ Ji and I G J,, then 



I < r 



ah - ai > Ci - Cr > . 



In particular, the sets Ji consist of consecutive indexes, and Ji < J2 < ■ ■ ■ < Jp (in terms of their 
elements). □ 



Proof. Let us assume that i < r £lp , h £ Ji and I £ Jr , but / < h (even less: that ai> a^,). Then 

gi ^ gi < Sg < Sjr and Sjr gi = Cr gi =^ an = WqhW^ < lb/ 11^ = ai < Cr < Ci . 

We also know that {gi , gn) = 0- Denote by Wh = = O/i gh and wi = = gi . Let 

gh{t) = cos(t) gh + sin(t) \\gh\\ wi and gi{t) = cos{-ft) gi + sin(7t) \\gi\\ Wh for t € M 

for some convenient 7 > that we shall find later. Let F^{t) be the sequence obtained by changing 
in F the vectors gh by gh{t) and gi by gi{t), for every t € M. Notice that = ah and 

= a; for every t G M, so that all the sequences F^{t) G Ca(^o)- 

Let W = span{i(;/i , w/}, a subspace which reduces Sjr and Sjr (j) . Note that gh{t-)-, gi{t) G W. In 
the matrix representation with respect to this basis of W we get that 



gh®gh 



gi ®gi 



Oh 




ai 



Wh 
Wl 



Wh 
Wl 



gh{t) ®gh{t) = ah 



and gi{t) gi{t) = ai 



cos^(t) cos(t) sin(t) 
cos(t) sin(t) sin^(t) 

sin^(7t) cos(t) sin(t) 
cos(t) sin(t) cos^(7t) 



Wh 
Wl 



Wh 
Wl 



If we denote by S{t) = 5'j-^(t) , we get that 



S{t) = S^-gh0gh-gi^gi + gh{t) O gh{t) + gi{t) gi{t) . 



Therefore S{t)\ 



St\w^ • On the other hand, Sj\w 



Ci 

Cr 



. Then 



Sit)\ 



w 



Ci + ah (cos^(t) — 1) + ai sin^(7t) o/j cos(t) sin(t) + a/ cos(7t) sin(7t) 
Oh cos(t) sin(t) + a; cos(7t) sin(7t) Cr + Oh sin^(t) + af (cos^(7t) — 1) 



Note that tr A^{t) = Ci+Cr for every t G M. Therefore A(A^(t) ) -< {ci , Cr) strictly 
+ . Hence we consider the map : M — )• M given by 



\A,{t)\\l< 



m^{t) = \\A^{t)\ 



tr(j4^(t)^) for every tG 



Note that 5(0) = 



(0) = cf + cl . We shah see that, for a convenient choice of 7, it holds 



that m' (0) = but m-^(O) < 0. This will contradict the (local) minimality of F, because rrij would 
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have in this case a maximum at t = 0, so that X{Ay{t) ) ~< (ci , Cr) strictly =^ A(S'jr^(t)) ^ ■^(•S'j") 
strictly Pf{T^{t) ) < Pf{T) for every t near 0. 

Indeed, we first compute the derivatives of the entries of A^{t) : 

- ^ , ...H- z-^; _ 2[-a, cos(2t)+72a, cos(27t)] 



—Qh sin(2t) + 7 a; sin(27t) 
^12 — '^h cos(2t) +70; cos(27t) and 
^22 = '^h sin(2t) — ^ ai sin(27t) 



a 



22 



2 [a/i cos(2t) - ^^ai cos(27t)] 



So a'ii{Q) = , 022(0) = and 012(0) = 0. Then, for i , j G I2 we have that 

(a2.)'(0) = 2 a,,(0) a^(0) = and (a2.)"(0) = 2( (a^)2(0) + a,,(0) <^.(0) ) . 

Therefore (afi)"(0) = Ac,{-ahW ai), (a?2)"(0) = 2 (a/,+7 a^^ and (a22)"(0) = -4c, (-a,,+72 a^) 
We conclude that m'^{0) = (for every 7 € M) and that 

m"(0) = 4 Cj(-a/, + 7^ a^) + (a/^ + 7 a/)^ - (-a,j + 7^ a/) 

which is quadratic polynomial on 7 with discriminant (if we drop the factor 4) given by 

D = Uh ai ah ai - {ai + (q - c,)) (o/j - (q - c,) ) 

As we are assuming that a/ > o/i then D > 0, because 

( ai + (cj - Cr)) {ah - (cj - Cr)) = ai ah - {ci - Cr){ai - ah) - (cj - c,)^ < ai ah . 

Hence there exists 7 € M such that m"(0) < 0. Observe that as long as < (cj — Cr){ai — ah) + 
(cj — Cr)'^ ( <^=^ ah — ai < Ci — Cr) we arrive at the same contradiction. □ 

The following result is inspired on some ideas from [1]. 

Proposition 5.5. Let (Jq > a) initial data for the CP, and let T = {Fq , Q) € Ca^(/o) m l5.il 
anrf l5.3i For every j < p, the subsequence {^ijigj^ 0/^ zs linearly independent. 

Proof. Suppose that there exists j € Ip-i such that {^ijieJj is linearly dependent. Hence there 
exists coefficients zi & C, I € Jj (not all zero) such that \zi\ < 1/2 and 



'^zi ai gi = . 



Let Ij C be given by Ij = {I ^ Jj : zi 0} and let h £ such that 
For t G (-1, 1) let F{t) = {To,g{t)) where g{t) = {gi{t)}iei, is given by 



(22) 

1 and Sj^h = Cp h. 



9l{t) 



{l-t^\zi\'^)^l^gi+tziaih if /G/j 

91 if / G Ife \ Ij 



Fix I ^ Ij . Let Re(^) = ^"^^ denote the real part of each A G L{7i). Then 

giit) gi{t) = {l-t^ |zi|2) gi®gi + \zi\'^ aj h®h + 2{l - Iz^P)^/^ t Re{h a, ff,) 

Let S{t) denote the frame operator of T{t) and notice that 5(0) = Sj^. Note that 

S{t) = S^ + t^Yl {-91 (^9i+af h^h) + R{t) 
leii 
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where R{t) = 2 ^ (1 — t Re(/i ai zi gi). Then R{t) is a smooth function such that 

i?(0) = , R'{0)=Y,^<h®aiZigi) = Re{h®Y,''i^i9i)=^ , 

and such that R"(0) = 0. Therefore hm t'"^ R(t) = 0. We now consider 

W = span {{gi : I e Ij} U {h}) = span {gi : I e Ij} ±C ■ h . 

Then dirnVF = s + 1, for s = dimspanjf^; : I G Ij} > 1. By construction, the subspace W reduces 
Sjr and S{t) for t € M, in such a way that S{t)\yy± = Sjr\^y± for i € M. On the other hand 

S{t)\w = St\w + t^Y. I^^l' (-91 ^9i + af h^h)+ R{t) = A{t) + R{t) € LiW) , (23) 

where we use the fact that the ranges of the selfadjoint operators in the second and third term in 
the formula above clearly lie in W. Then A( Sj^-jvi/ ) = ( Cj Is , Cp ) € (Mt^"^)-'- and 

>^{Eiei,\^i\^9i(^9i) = (71 , • • • , 7s , 0) G (M?.+^)^ with 7s > , 

where we have used the definition of s and the fact that \zi\ > for I ^ Ij . Hence, for sufficiently 
small t, the spectrum of the operator A{t) e L{W) defined in ([25]) is 

A ( A{t) ) ={cj-t'j,, ... ,cj-t^jucp + t' Eiei, P ) e i^>o')^ > 
where we have used the fact that {gi , h) = for every I ^ Ij . Let us now consider 

A(i?(t)) = (5i(t), ... , 5s+i(t)) G (Mgi)^ for tGM. 
Recall that in this case \mit~'^5j{t) = for 1 < j < s + 1. Using Weyl's inequality on Eq. (j23p . we 
now see that A( S{t)\w ) -< X{A{t) ) + A( R{t) ) = p{t) G (M>V)^. We know that 

pit) = {cj -t'^js + Slit) , ■ ■ ■ , Cj -t^ji + (5s (t) , Cp + t^ ^i&ij I^'l^ + ^s+iit) ) 

,-i2(7s-^),...,c,-t2(7i-^),c, + i2(E.,,,.«fkP + %^)) . 

A direct test shows that, for small t, this p{t) -< A(5jrj^) = (cj Is , Cp) strictly. Then, since / is 
strictly convex, for every sufficiently small t we have that 

P/(-^(t)) <tr/(A(5^|H/x))+tr/(p(0) <tr/(A(5^|t^x))+tr/(A(5^lM/)) =P/(J-) • 
This last fact contradicts the assumption that is a local minimizer of Pf in C'^{J-q). □ 

Remark 5.6. Proposition 15.51 allows to show that in case J-q = then local and global minimizers 
of a convex potential Pf, induced by / S ConVs(M>o), on Cai^o) - endowed with the product 
topology - coincide, as conjectured in [30J. 

Recall that a local minimizer is a juxtaposition of tight frame sequences {J'i}i£_ip which generate 
pairwise orthogonal subspaces of %. Notice that by |34^ Lemma 4.9] is a frame for 71. Moreover, 
by Proposition 15. 4t it is constructed using a partition of a with consecutive indexes. 

Now by inspection of the proof of Proposition 15.51 we see that only one of such frame sequences can 
be a linearly dependent set: that with the smallest tight constant Cp. This forces that the (ordered) 
spectrum v oi a. local minimizer must be either v = cl^ or 

= (oi , 02 , . . . , a,. , c , • • • , c) , where > c > ar+i , 
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and c is the constant of the unique tight subframe constructed with a hnear dependent sequence of 
vectors with norms given by {aj}^!^^_|_^ (notice that this forces c > 0^+1). But it is not difficult to 
see that this vector can be constructed in a unique way, that is, there is only one r such that 

O-r+l < C = - ^ tr(a) — Oj ^ < ttr ■ 

i=l 

That is, the spectrum of local minimizers is unique and therefore local and global minimizers of Pf 
coincide, for every potential Pj as above. A 

5.2 Several proofs. 

Let (J-Q , a) be initial data for the CP with A = X^{Sj^g), a = a~'' and d < k. Recall that we denote 
by hi = Xi + Qi for every i G 1^ and, given j , r G 1^ such that j < r, we denote by 

1 1 

Pj ,r = r-j+l Til — r-j+l T + C-i ■ 
i=j i=j 

We shall abbreviate Pi = Pr ■ 

5.7 (Proof of Theorem 14. 4|) . We rewrite its statement: Let [Tq , a) be initial data for the CP 
with d > k. Let = (J-q , G) € Ca^(J-o) be a global minimum for Pf on Ca^(J-o). Using the 
notations of l4.lt assume that A = A^(S'j-y), fi = fi^ = ij,f[X , a) and a = a^. Then 

1. There exist indexes = sq < si < • • • < Sp_i < Sp = sj^ = max{j G I^^ : fij ^ 0} such that 

= Jj = {sj-i + l, ■■■ , Sj} , , for i G Ip-i , 

(24) 

2. The vector z^/(A , a) = ( ci l^^ , . . . , Cp lsp-sp_i , A^^+i , . . . , A^ ) , where 

Cr = — ^ hi = Ps,_i+i,s, for r G Ip_i , (25) 

or also Cr = Aj + /ij for every j ^ Kr = Jr for r G Ip-i . 

3. The constant Cp is the one defined by the feasible final part i.e., Cp = Qsp-i,sp of and 
the indexes Sp_i and Sp are determined by the last block, which is feasible. 

Proof. Recall from Eq. (jlSp that for every j G Ip-i 

== ker {S — Cj Iw ) = spanjuj : z G -fCj} = spanjf^j : i G Jj} 

By Proposition 15.51 1 Jj| = dimWj- = \Kj \ for j < p. Using now Propositions 15.21 and 15.41 we deduce 
that there exist indexes = sq < si < S2 < • • • < Sp-i < Sp = sj^ = max{j G 1^ : / 0} such 
that the sets Kj and Jj satisfy Eq. (fM|) . Using Eq. (fTSj) again, 

Sg\Wj = TiieJ, 9i^9i =^ tr Sg\w, = T.ieK, = TieJ, ■ (26) 

Therefore {sj - sj-i) cj = tr S\wj = tr Sjr^lw^ + tr Sg\w^ = Yli^Kj > every j < p. Then the 
vector z^/(A, a) = (ci 1^^ , ■ ■ ■ , Cplsp-Sp_i , Xsp+i , ... , X^), where the constants Cr are given by 
Eq. ()25p for r < p. Item 3 follows from Remark 14.21 and Lemma 13.161 □ 
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Lemma 5.8. Let (J-q , a) be initial data for the CP with k > d. Given m G , 

(oi)ieim -< [Pm - ^j)j&n. "^=^ Pm > Pi for every i € 1^ Pi,m = max{Pi,i} . 

Proof. Straightforward. □ 

Remark 5.9. Let (J-q , a) be initial data for the CP with k > d and recall the description of a 
minimum i^f{X, a) given in Theorem 14.41 As in Lemma 15.81 (or by an inductive argument using 
Remark 14. 2p we can assure that for every r < p — 1, the constants 

Cr = Psr-i+i,sr > Psr-i+i,j for cvery j such that Sr-i + 1 < j < Sr ■ (27) 

It uses that (aj)jLs,_i+i ^ (Mj)jLs,_i+i = (cr - Aj)^Ls,_i+i , a consequence of Eq. ([26]). A 
Lemma 5.10. Let (J-q , a) be initial data for the CP. With the notations of Theorem\4.4[ the global 



minimum z^/(A, a), its constants cj and the indexes sj (for j G Ip) satisfy the following properties: 
1. Suppose that p > 1. For every j G such that j > 1, the constant Cj satisfies that 



1 ' 1 

2. Fix j G Ip-i such that j > I. Then 

Pi,t<Pi,Sj.i for every sj-i < t < Sp-i . (29) 

3. In particular the averages Pi,Sj = — hi < hi = Pi^ g^. ^ for 2 < j < p — 1. 

Proof. The inequality of item 1 follows since 

= Sl Cl + (S2 - Si) C2 + . . . + {Sj - Sj-l) Cj > Sj Cj . 

Now we prove the inequality of Eq. ([29]) : Given an index t such that Sj-i < t < Sj , 

tPl,t = Sj-lPl,s,^i+YA=s,^i+lhi 

= Sj-iPi^Sj.i + {t- Sj-i) ^t_s,^^) E*=s,_i+i hi 
113 

< Sj^lPl^s,.i+{t- Sj-l)Cj 
< Sj-l + {t- Sj_l)Cj_l 

— -^i-i P^,sj-i + ~ '^i-i) -Pi = tPi,Sj-i , 

where we used the fact that Cj-i < Pi^Sj-i for 1 <j — 1 <p— 1, which follows from item 1. In 
particular we have proved item 3, and this also proves that Eq. (|29p holds for Sj < t < Sp_i . □ 

Proposition 5.11. Let {J-q , a) be initial data for the CP. With the notations of Theorem \4.4\ the 

global minimum v = i^f{X, a), its constants Cj and the indexes Sj (for j G Ip) satisfy the following 
properties: Suppose we know the index Sp_i , and that p > 1. Then we have a recursive method to 
reconstruct v: 



Sj_l+l,Sj — _ ^ ^ 

5-1 S j — \ , ^ i ■ -I 

■> l = Sj_l + l 1 = 1 
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1. The index si = max \j < Sp_i : Pi j = max Pi^i \, and ci = Pi^si ■ 

i<Sp-i 

2. If we already compute the index sj and sj < Sp-i , then 

Sj+i = max [sj <r < Sp_i : Psj+i,r = max Ps^+i^i} and cj+i = • 

s j <Ci^Sp— 1 

Proof. The formula Pi^si = max Pi ^ i follows from Lemma 15.81 and Eq. ()29p of Lemma \5.10\ 

i<Sp-i 

which also implies that si must be the greater index (before Sp-i) satisfying this property. 

The iterative program works by applying the last fact to the successive truncations of u which are 
still minima in their neighborhood, by Remark 14. 2 i □ 

Recall that /ij = Aj + and that, for < j < r < d, we denoted by 



and we abbreviate Qi^r = Qr ■ Recall also the notion of feasible indexes given in Definition 14.51 
Let (J-Q , a) be initial data for the CP with A = X^{Sjr^^) and k > d. Given s G ^d-i denote by 
A'* = [Xs+i , . . . , Arf) € M'^^* and a* = (os+i , . . . , a^), the truncations of the original vectors A 
and a. Recall that the index s is feasible if the pair (A* , a**) is feasible for the CP. In any case we 
denote by 

z^s = J^(A% a^) = (clr-s , Ar+i , . . . , Arf) where c = Qs,r 

for the unique r > s such that A^ < c < A^+i . This means that Xs^i^s € (M^~'*)^ and that 
tr Us = tr A* + tr a* . 

Lemma 5.12. Let (J-q , a) be initial data for the CP. Fix an index s € Id-i U {0} . Then 

1. The index r associated to Vg as in the previous notations is given by 

r = max {w (zld ■ w > s and Qs,w = min Qs,j } ■ 

j>s 

In other words, r is the unique index which satisfies: Given j > s, 

Qs,r<Qs,j if j>r and Qs,r<Qs,j if j<r. (31) 

2. Given an index I € Id-i j 

I > s and Qs,i < Ai+i =^ I >r , (32) 
where r is the index associated to Vg of item 1. 
Proof. Item 1 follows from Proposition 13.141 applied to A** and a*. 
Item 2 : Assume that I < I + 1 < r. Then Qsj< A^+i < Xr < Qs ,r ■ In this case 

tr A^ + tra^ W (l-s)Qsj + E A, 

i=l+l 

= ii-s)Qs,i + E \+ E k 

l+l<i<r i=r+l 

<{r-s)Qs,r+ E A, tr A^ + tr aS 

i=r+l 

a contradiction. Hence I > r. □ 
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Proposition 5.13. Let [Tq , a) be initial data for the CP which is not feasible, with k > d. Let 

s* = min { s € Irf : s is feasible } . 

Let V* be constructed using the recursive method of Proposition [5.11{ by using s* instead o/sp_i 
(which can always be done). Then if we get the constants ci > . . . > Cg_i , and we define Cq as the 
feasibility constant of and , then Cq-i > Cq . 

Proof. For simplicity of the notations, by working with the pair (A''''"^ , a^^'-^), we can assume that 
q = 2. Denote by si = s* < S2 and ci , C2 the indexes and constants given by: 

-j^ Sl 1 / \ 

ci = — /ij = -Pi , SI and C2 = Qs^ , S2 = ^« + ' (^3) 

Sl S2 - si \ . . / 

1=1 \l = Sl + l «=S2 + 1 / 

and we must show that ci > C2 . Recall that hi = Xi + Ui . We can assume that: 
• By Proposition 15.111 ci > - J2 = Pi ,p for every p G I^i • 



t=i 



C2 > E hi = Psi+i ,p for every si + I < p < S2 ■ 



p 
I 

j = Sl + l 

Xs2 < C2 < Xs2+1 



where the second item follows by the feasibility of s* and the last item says that C2 is the feasible 
constant for the second block. 

Suppose that ci < C2 and we will arrive to a contradiction by showing that, in such case, the pair 
(A , a) would be feasible (that is, s* = or Sg-2)- In order to do that, let 



t eld and b = Qt = J Y^i=i hi + T.i=t+i 
be the unique constant such that Xt < b < Xt+i , which appears in v^X , a). Then 

(S2 k \ 

Yjhi+ Yl = ^(Sl Cl + (•52 - Si) C2) < C2 < As2 + i . 

1=1 i=S2+l J 

By Eq. (|32p we can deduce that t < S2 ■ Moreover, by item 1 of Lemma 15.121 we know that 

b = Qt = i f E + E a,) <l^J2h^+ E aA=Qp for every pela- (34) 

Vi=l i=t+l / \i=l i=p+l J 

In particular, b < c < C2 . On the other side, ci < b. Indeed, li u = i/(A , a) then 

A ^ z^* and t = ix v* = tx u =^ u ^ u* =^ b = I'l > I'l = ci , 
because ci < C2 =^ f* = (i^*)^ and since = z^^ is the ^-minimum of the set 

{A^(S') : S'j-,, < S and ix S = t} = {p = : X^ p and tr p = t} , 
by the remarks at the beginning of Section 13.31 and Proposition 13.141 

To show the feasibility, by Lemma 15.81 we must show that b > Pi^p for every p e It ■ First, if we 
are in the case t < si , this is clear since b > ci > Pi^p for every p < si . Finally, suppose that 
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t > Si + 1. As before, b > ci implies b > Pi^p for every p < si . On the other hand, if si < p < t 
then Lemma 15.121 appUed to (whose "r" is S2 ) assures that 

C2 <Qsi,t =^ {t - si)c2 < Yl hi+ Yj at = tb - sici . 

i=si+l i=t+l 

Since p <t and b < C2 , this imphes that {p — si) C2 <pb — si ci . Therefore 

pPlp = Sl Cl + (p - Sl) Psi + l,p < Sl Cl + - Sl) C2 < p6 . □ 

Proposition 5.14. Let (J-q , a) 6e initial data for the CP. With the notations of Theorem. \4.4\ the 
global minimum Vf{\, a) satisfies that 

Sp_i = min { s € Irf : s is feasible } . 

Proof. Denote by s* the minimmn of the statement. Since Sp_i is feasible (recall the remark after 
Definition I4.5p . then s* < Sp_i . On the other hand, let us construct the vector u* of Proposition 
15.131 using the iterative method of Proposition 15.111 with respect to the index s = s* , and the 
solution for the feasible pair (A* , a* ) after s* . Write i'* = {u^ , . . . , v* , clr~s , K+i 1 ■ ■ ■ , A^), 
where c is the constant of the feasible part of v*. Observe that Proposition 15.131 assures that 
c < min{f* : 1 < i < s}. 

Using this fact and Proposition 15.111 it is easy to see that the vector fi = u* — satisfies that 
^ = On the other hand Lemma 15.81 and Remark 15.91 assure that sl ~< jx (using the majorization 
in each block and the fact that a = a^). Then /i G r(^(a) and v* € Aa''(A), the set defined in Eq. 
©. 

Moreover, in each step of the construction of the minimum v = ^'/(A , a) we have to get the same 
index Sj = Sj{u*) of u* or there exists a step where the maximum which determines Sj (for i'f{\ , a)) 
satisfies that Sj > s* (in the eventual case in which Sp_i > s*). 

In both cases, we get that v* < ui for every index 1 < i < s* . Consider the subvector of v* 
given by p = (z^* , . . . , i/* , A^+i , . . . , A^) € M''+'^~'", and the respective part of Vf{X , a) given by 
^ = (i^i , . . . , z^s , Vr+i ) • • • I'd)- Since tr v* = tr i/, the previous remarks show that 

=^ P <wi =^ {P, Clr-s) -< , I's+l , . . . , I^r) , 

where the final majorization follows using Lemma 4.6 of [33], which can be used since the constant 
c < min{f* : 1 < i < s} by Proposition 15.131 (and because c < A^+i). Since majorization is 
invariant under rearrangements, we deduce that v* ~< i'. 

Finally, using Theorem 13.71 we know that z^ = z^/(A , a) is the unique minimum for the map tr /(•) 
in the set Aa''(A). This implies that i^* = u, and therefore Sp_i = s* . □ 
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